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Abstract 

A new type of 5(3 basic hypergeometric series based on Macdonald polynomials is intro- 
duced. Besides a pair of Macdonald polynomials attached to two different sets of variables, 
a key-ingredient in the 5(3 basic hypergeometric series is a bisymmetric function related 
to Macdonald's commuting family of g-difference operators, to the 5(3 Selberg integrals of 
Tarasov and Varchenko, and to alternating sign matrices. Our main result for SI3 series 
is a multivariable generalization of the celebrated g-binomial theorem. In the limit this 
g-binomial sum yields a new 5(3 Selberg integral for Jack polynomials. 

1. Introduction 

The g-binomial theorem, which was independently discovered by Cauchy, Heine and Gauss (with 
special cases due to Euler and Rothe) is one of the most important results in the theory of g-series, see 
e.g., [1,6] and references therein. Using the standard notation (a; q)n = {l — a){l — aq) ■ ■ ■ {l — aq"'~^) 
for the g-shifted factorial, the theorem may be stated as 
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for |g| < 1 and \z\ < 1. A well-known alternative representation of the (^-binomial theorem is as the 
g-beta integral (for the definition of g- integrals see [6]) 
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where < g < 1, is the g-gamma function [6], 

(«; q)z = for z € c, 

and a,/3 G C such that Re(a) > 0, — /3 ^ {0, 1,2, ... }. Assuming Re(/3) > and taking the limit 
g ^ 1~ it follows that the q-binomial theorem implies Euler's beta integral [1] 
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Building on the pioneering work of Milne and Gustafson on multivariable basic hypergeometric 
series, many generalizations of the g-binomial theorem have been found in recent times. Most of these 
are labelled by one of the classical root systems, see e.g., [4,7,18,20,21]. A particularly interesting 
generalisation of the g-binomial series is obtained when z'^ in (jl.ip is replaced by an appropriate 
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symmetric function such as the Schur function or Macdonald polynomial, see [3,9,17,19]. The latter 
case was independently considered by Kaneko and Macdonald, who proved that [9,17] 
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Here P\{x; q, t) is the Macdonald polynomial labelled by the partition A, n{X) = Yli>i{^ ~ 1)^1) and 
c'^{q,t) and {a;q,t)x (defined in Section \27L\i are generalisations of the g-shifted factorials {q;q)k 
and (a; q)k, respectively. If x contains a single variable then the partition A is restricted to only one 
part, and (jl.2p reduces to the ordinary g-binomial theorem (jl.ip . 



Analogous to the single-variable case, (11. 2p may be transformed into a multiple g-integral. In 
the q ^ 1^ limit this implies the famous Selberg integral [23] 
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for Re(a)>0, Re{(3) > 0, Re(7) > - min{l/n, Re(a)/(n - 1), Re(/?)/(n - 1)}. 



In this paper we take the natural next step in the development of basic hypergeometric series 
and prove an 5(3 version of the Kaneko-Macdonald (7-binomial theorem: 
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for y = z{l, t, . . . , t"^^) and ^ m ^ n. The series on the left (defined in Section [5|) depends on two 
Macdonald polynomials, Px{xi, . . . , Xm', q, t) and P^(yi, . . . , y„; t), and — as a new ingredient — 
involves a bisymmetric function related to Macdonald's commuting family of (^-difference operators 
[16]. 

As in the previous two cases one may transform the 3(3 basic hypergeometric series into a multiple 
g-integral. The 5 — > 1~ limit then yields the sis Selberg integral of Tarasov and Varchenko [25] 
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where C™'"[0, 1] is an integration domain described in Section [5l h{x, y) is the bisymmetric function 

{n-m)\ ^ -p-f yl^ 



h{x,y) 



ni 



n m 

E n 

/l,...,/m = l 4 = 1 



yu - Xi 



5(3 Basic hypergeometric series 



and (for generic n and m) 

Re(a) > 0, Re(/?i) > 0, Re{p2) > 

,,,n|l, SSM, MA) , Re(ft) R.(ft+ft)| ^ ^ „ 
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1.1 Outline 



In the next section we provide a brief introduction to Macdonald polynomials and the 5I2 Kaneko- 
Macdonald multivariable basic hypergeometric series. Then, in Section [3l we define the bisymmetric 
function F{x, y; t), which plays a key-part in the 3(3 basic hypergeometric series studied in this paper. 
We prove several elementary results for F, and establish a connection with the bisymmetric function 
of Tarasov and Varchenko, and with alternating sign matrices. In Section H] we obtain an identity 
involving the g, t-Littlewood-Richardson coefficients and a specialization of the function F. This 
identity is at the heart of our proof of the 3(3 g-binomial theorem (|1.4p . Finally, in Section we 
define the 3(3 basic hypergeometric series and prove several g-binomial theorems as well as a (more 
general) g-Euler transformation. Taking the {q,t) — > (1~,1~) limit of the 5(3 g-binomial theorem 
(such that (1 — t)/(l — g) ^7) yields a generalization of the Tarasov- Varchenko integral (jl.Sp 
involving the Jack polynomial. 



2. Macdonald polynomials 

2.1 Preliminaries 

Let A = (Ai,A2,...) be a partition, i.e., Ai ^ A2 ^ • • . with finitely many Aj unequal to zero. 
The length and weight of A, denoted by and |A|, are the number and sum of the non-zero 
Aj respectively. As usual we identify two partitions that differ only in their string of zeros, so that 
(6, 3, 3, 1, 0, 0) and (6, 3, 1, 1) represent the same partition. When |A| = N we say that A is a partition 
of A^, and the unique partition of zero is denoted by 0. The multiplicity of the part i in the partition 
A is denoted by mi = mi{X), and occasionally we will write A = (i''"i2"^2 _ _ _ 

We identify a partition with its Ferrers graph, defined by the set of points in (i,j) € such 
that 1 ^ j ^ Aj, and further make the usual identification between Ferrers graphs and (Young) 
diagrams by replacing points by squares. 

The conjugate A' of A is the partition obtained by refiecting the diagram of A in the main 
diagonal, so that, in particular, mj(A) = A^ — X[_^_i- The statistic n{X) is given by 

n(A) = - l)Xi = 

The dominance partial order on the set of partitions of is defined by A ^ /i if Ai -|- • • • + Aj ^ 
/Ui + • • • -|- for alH ^ 1. If A ^ /X and A 7^ /x then X > fi. 

If A and /i are partitions then /i C A if (the diagram of) /x is contained in (the diagram of) A, 
i.e., Hi ^ Aj for all i ^ 1. If /x C A then the skew-diagram X — ^ denotes the set-theoretic difference 
between A and /x, i.e., those squares of A not contained in /x. 

Let s = be a square in the diagram of A. Then a(s), a'{s), l{s) and l'{s) are the arm-length, 
arm-colength, leg-length and leg-colength of s, defined by 

a{s) = Xi-j, a'{s)=j-l 
l{s) = X'j - i, l'{s) = i-l. 
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This may be used to define the generalized hook-length polynomials [16, Equation (VI. 8.1)] 

cx{q,t) = ]j{l-q'=^^-^k'('^+'), (2.1a) 

sex 

Cx{q,t) = ll{l-q^^'^+H^^'^), (2.1b) 
where the products are over all squares of A. We further set 

h(,,t) = ¥f4- (2.2) 
Observe that if A contains a single part, say k, then 

c[k)i<i^'t) = iq;q)k- 

For a nonnegative integer the g-shifted factorial {b;q)]\f is defined as {b;q)o = 1 and 

ib;q)N = (1 - 6)(1 -bq) ■■■{!- bq""''). (2.3) 

We also need the g-shifted factorial for negative (integer) values of A^. This may be obtained from 
the above by 

[bq ^■,q)N 

This implies in particular that l/(q;q)_Ar = for positive A^. 
The definition (j2.3p may be extended to partitions A by 

1{X) 

{b;q,t)x = - bq'^'^'h-''^'^) = ll{bt^-';q)x,. 

sGA i=l 

With this notation the polynomials (j2.1|) may be recast as [9, Proposition 3.2] 

cx{q,t) = it-;q,t)x J] (lt^l'^^T'' ' ^2.4a) 

where n is any integer such that n ^ Z(A). 

Finally we introduce the usual condensed notation for (/-shifted factorials as 

(ai, . . .,ak;q)N = {ai;q)N ■ ■ ■ {ak;q)N 

and 

(oi, . . . , Ofc; q, t)x = (ai; g, t)x--- (a^; q, t)x. 
2.2 Macdonald polynomials 

Let Sn denote the symmetric group, acting on x = (xi,...,Xn) by permuting the Xi, and let 

An = Z[ 

xi, . . . ,Xn] " and A denote the ring of symmetric polynomials in n independent variables 
and the ring of symmetric functions in countably many variables, respectively. 

For A = (Ai,...,A„) a partition of at most n parts the monomial symmetric function mx is 
defined as 

mx{x) = ^a;", 

where the sum is over all distinct permutations a of A, and For 1{X) > n we set 

mx{x) = 0. The monomial symmetric functions mx for /(A) ^ n form a Z-basis of A„. 
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For r a nonnegative integer the power sums pr are given by = 1 ^ind pr = mj-^) for r > 1. 
Hence 

Pr{x) = Y,<- (2.5) 

More generally the power-sum products are defined as p\{x) = px^{x) ■ ■ ■p\^{x). 
Following Macdonald we define the scalar product (•, ■)q^t by 

1=1 

with z\ = Y\i>i rrii-'i^^ and mj = mj(A). If we denote the ring of symmetric functions in n variables 
over the field F = Q(g, t) of rational functions in q and t by Anj, then the Macdonald polynomial 
P\{x;q,t) is the unique symmetric polynomial in A„^f such that [16, Equation (VI. 4. 7)]: 

Px{x; q, t) = mx{x) + ^ ux^j,{q, t)m^{x) (2.6) 

and 

{Px,P^.),,t = if A^/x. 

The Macdonald polynomials P\{x;q,t) with /(A) ^ n form an F-basis of A„_f- If K^) > ^ then 
Px{x;q,t) = 0. From (j2.6p it follows that Px{x;q,t) for /(A) ^ n is homogeneous of degree |A|: 

Pxizx;q,t)=z\^\Pxix;q,t) (2.7) 

with z a scalar. 

When q = t the Macdonald polynomials simplify to the well-known Schur functions: 

Px{x;t,t) = sx{x). (2.8) 
The latter are defined much more simply as 

_ deti^i,j^„(3;^+""^) _ deti^^j^n(x^+"~-^) 

where 

is the Vandermonde product. 

For / G An.¥ and A a partition such that /(A) ^ n the evaluation homomorphism n^""* : A^^p F 
is defined as 

u^x\f) = /((z'^r-\ . . . , (?""t°). (2.10) 

We extend this to / G F( xi, . . . , Xn) " for those / for which the right-hand side of (j2.10p is well- 
defined. According to the principal specialization formula for Macdonald polynomials [16, Example 
VI.6.5] 

, , 1 „a'(s)j.n—l'(s) (j.n. „ 

ut\Px) = t<'^ n \ u^l = (2.11) 

° ^ ^ ^\ I- q^{s)il(s)+i cx{q,t) ^ ' 

For more general evaluations we have the symmetry [16, Equation (VI. 6. 6)] 

uf(P,)ut\Px) = u(-\Px)u^:\P,) (2.12) 

provided l{X),l{fi) ^ n. It will also be convenient to define the homomorphism li^"] as 

u^^lif) = f{zq^H^-\zq^H^-\ zqH^). (2.13) 
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For homogeneous functions of degree d we of course have 



(2.14) 



Thanks to the stabihty Px{xi, . . . , Xn] q, t) = Px{xi, . . . , Xn, 0; q, t) for 1{X) ^ n, we may extend 
the Px to an infinite alphabet, and in the remainder of this section we assume that x (and y) contain 
countable many variables so that we will be working in the ring Af = A 0^ F instead of A„^f. By 
abuse of terminology we still refer to Pxix; q, t) as a Macdonald polynomial, instead of a Macdonald 
function. 

For b an indeterminate, the homomorphism ea,t : Ap ^ F is defined by its action on the power 
sums pr as [16, Equation (VI. 6. 16)] 

, . 1-6^ 



1 - 1*" 



According to [16, Equation (VI. 6. 17)] 



A 

We also note that for any symmetric function / 

£*",*(/) =4"^(/)=/(l,t,...,t"-'), 
compare for example (j2.1ip and (12.16p . 

The q, t-Littlewood-Richardson coefficients are defined by 

P^(x; q, t)P,{x- q,t) = Y, f^.i^^ O^A(a:; q, t), 



(2.15) 



(2.16) 



(2.17) 



(2.18) 



and trivially satisfy 
and 



fU<l^t) = f^^{q,t) 



flluiQ^t) = unless 



1^1 + I'^l- 



It can also be shown that [16, Equation (VI. 7. 7)] 



f^uiQ^t) = unless i/ C A. 



(2.19) 



(2.20) 



The q, t-Littlewood-Richardson coefficients may be used to define the skew Macdonald polyno- 
mials 

Px/^ix;q,t)=^f^,iq,t)P,ix;q,t). (2.21) 

V 

By ()2.20p . Pxi^{x;q,t) = unless ^ C A (in which case it is a homogeneous of degree |A| — |^|). 
Equivalent to (I2.2ip is 

Px{x,y;q,t)=Y,Pyi^{x-q,t)P^{y;q,t). (2.22) 

Finally we need the Kaneko-Macdonald definition of 5(2 basic hypergeometric series with Mac- 
donald polynomial argument [9, 17] 

,n(A) P\{X'^ 9> t) (Ol, • • • , «r+i; ^, t)x 
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(2.23) 



In the single- variable case, x = (z), this reduces to the classical r+i't'r basic hypergeometric series [6]: 



r+l^r 



ai, . . . , ttr+l 

bi,...,br 



;q,t; (z) 



y-^ («!, ■ ■ ■ , Or+i; g)fc 



k=0 



{q,bi, . . .,br;q)k 



Oi, . . . , ar+l 
bi,...,br 
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The main result for Kaneko-Macdonald series needed in this paper is the (j'-binomial theorem [9, 
Theorem 3.5], [17, Equation (2.2)] (see also [16, page 374]) 

{aXi;q)oo 



1^0 
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(2.24) 



which is (|1.2|) of the introduction. Those familiar with Macdonald polynomials will recognize the 
intimate connection with the Cauchy identity [16, Equation (VI.4.13)] 

{tXiUj 1 9)00 



{xiyj;q)c 



(2.25) 



with b\{q,t) defined in ()2.2p . Acting with the homomorphism ea,t on the left (with ea^t acting on y) 
and using (|2.2|) and (j2.16|) immediately gives the above i<I>o series, so that (|2.24p is equivalent to 



n 



{txiyj;q)c 
{xiyj;q)o. 



n 



{axi;q)c 



(2.26) 



3. The bisymmetric function F 

Unless stated otherwise m and n are integers such that ^ m ^ n, and x = (xi,...,Xm) and 
y = (2/1, . . . , yn)- Given such x we set 

2^( li 2) l iv) _ . . . , . . . , Xjj — 1 , 3^12+1 ) • • • 5 3Jijv~l ' -^iiv+I ' • • ■ ' Xm) 

for integers 1 ^ ii < ^2 < • • • < «Af ^ w-. We further use the shorthand notation 

(^(p+l,...,,n)^ = (Xi, . . . , Xp, 0_0), 

m—p times 

and apply the same notation to y = (yi, . . . , yn)- 

The symmetric group will feature prominently in this section, especially in the proofs. In total 
we employ the symmetric group acting on 4 different sets of variables, sometimes of the same 
cardinality. To avoid ambiguity we write 

instead of the more common 

with similar notation for other sets of variables. 
3.1 Definitions and results 

Let r be a nonnegative integer not exceeding m. Macdonald introduced the commuting family of 
g-difference operators Dr as [16, Equation (VI. 3. 4)^] 

/C[m]jG/ i&I 
\I\=r 

where [m] = {1, 2, . . . , m} and 

'PqjXi (/(x)) — /(xi, . . . qXi , , . . . , Xfn) 

the g-shift operator acting on Xj. 
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Defining the generating series 

m 

D{u-q,t) = Y,Dr{-uY 

r=0 

Macdonald showed that for /(A) ^ m the P\ are the eigenfunctions of D{u;q,t) [16, Equation 
(VI.4.15)]: 

D{u;q,t)Px{x;q,t) = gx{u; q,t)Px{x; q,t), (3.1) 

with eigenvalue 

m 

gxiu;q,t)=ll{l-ut"^-'q'^). 
1=1 

In [10, Equations (1.12) and (1.13)] Kirillov and Noumi combined the Cauchy identity (j2.25p 
with (j3.ip to obtain 

bxiq, t)gx{u; q, t)Pxix; q, t)Pxiy; q, t) = F{u; x, y; t) fj J] (3.2) 

A i=ij=i y^iyj^^)°o 

where the bisymmetric function F{u; x, y; t) is given by 



F(n;x,,;t)= 2:(-n)lV^')n^nn^^- (3-3) 



In the Section [5] we define two types of 5(3 basic hypergeometric series featuring particular 
speciahzations of F . In our study of these series several elementary results for F are needed. Proofs 
of all claims may be found in Section 13.31 



Lemma 3.1 (Stability). We Lave 

F(n;x,y;t)|,„,„=i = F(n; t) (3.4a) 

and 

F(n;a;,y;t)|,„=,„=o = (1 - n)F(nt; x^'") , t). (3.4b) 

The formulae (j3.2p and (j3.3p also make sense when y contains countably many variables (pro- 
vided, of course, we replace 11^=1 by nj>i)- the following we assume such y. 

Lemma 3.2. With ta,t acting on y = {yi,y2, ■ ■ ■) we have 

eut^'\t {Fiu;x,y;t)) =Y[ ^_ . (3.5a) 

1=1 * 

and 

ea,t{F{l;x,y;t)) = t^^)^! • • • TT . (3.5b) 

1 — axi 

1=1 

It easily follows (see Section [3^ that 

-i-r tXi — Xj -r-r ^ — Xi 



IClm] iel ■> i&I 



(3.6) 



5(3 Basic hypergeometric series 
so that Lemma 13.21 is equivalent to the pair of identities 

y n ^^i^ n = ft ^"""^"T (3.7a) 

/C[m] iG/ is/ J=l 

and 

E (-1)"'*'"' nf^Hi^ ..n\^- (3.7b) 

/C[m] «e/ ■' i&I 1=1 

This shows that ()3.5ap and ()3.5bp are in fact equivalent: taking (j3.7ap and making the substitutions 
u at"^~^, Xi l/{axi) and I ^ [m] — I yields ()3.7bp . 

The results that we will actually need in Section [S] correspond to the principal specialization 
formula, obtained by choosing u = ^"^"^+1 or a = in Lemma 13.21 and using (j2.17p . 

Corollary 3.1 (Principal specialization). With Uq"^ acting on y = (yi, . . . , y„) we have 



m 



, , 1 _ j-i+n-m 

4")(F(t— +^x,y;t))=nV^ 

and 

4"^ (F(l; X, y; t)) = t(^)xi ■■■XmH^ 
These last two results are suggestive of 



^ -I 'i+n—m 



1 - f 



1=1 



m n 



F(l; X, y- 1) = t(T)-(2)F(r— +1; X, y- t)\{x,\[ y,, 

i=i j=i 

but this is in fact only true for m = n as will be shown in (13.121) below. 

The function F may be connected to the bisymmetric function introduced by Tarasov and 
Varchenko in their work on 5(3 Selberg integrals [25]. To this end we define 

oj{x,y;t) = F{l;x-\y;t), (3.8) 

where x~^ = {x^ , • • • , 2;"^). From (13. 3p it follows that 

, n 

„; t) = E n ^ n n p.") 

IC[m] iei * ^ iei j=i * ^-^ 

Proposition 3.1. Let k be an integer such that I ^ k ^ m. Then 

Th Tfl 111 

a;(x, y; t) = (1 - t) J] a;(x('=), y« ; t) J] H (^-lO) 

^ Xfc - tyi fj^ Xi - tyi fj^ yi - yi 

Since u>{-,y;t) = 1 we may use p.lOp and induction to find the following alternative multisum 
expression for iv. 

Corollary 3.2. We have 
a;(x,y;t) = r (l-i)'" 

X f ft n ft^^^ n ^iZ^.^fl^. (3.11) 

i,,.tc=i T=i " ^y^^ f=i 7=1 ~ i^hi^^m - vh - vh 

hjtlj ljth,...,lm 
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Note that for m = n this is equivalent to 

^t^, Vfi^.-%i^,y^„^.-iy, y^-yJ 

from which it readily follows that 



n 

i=i 

or, equivalently, 



X, y; t) = F{1; x-\y-^;t-^) H Xiy,. 

i=l 

Since it follows from (j3.3p that for general ^ m ^ n 

F{u; X, y- 1) = F(nr~"-i; y'^ t"^), 

we also have 

n 

F{1; X, y; t) = F{t; x, y; t) J] x^yi (3.12) 

when m = n. 

Using Corollarv 13.21 we may achieve the further rewriting of lo as follows. 
Proposition 3.2. We have 

H»^-n)(l_^)n+m ^ ^ y^+n-m TT " % 



wG&xX&y i=l l^i<j^n 

X II ""--yi+n-m ^ Xi-^Xj \ ^^^^^^ 

The representation of uj{x,y;t) provided by (j3.13p immediately implies that 

lim F(l; g-^ g"; q^) = lim u{q\ q^; q'') = (z^l!^ ^^u, v; 7), (3.14) 
q^i q^i (n — my. 

where w{u,v;j) is the bisymmetric function of Tarasov and Varchenko [25, Eq. (2.2)], and q^ = 
{q-\...,q^^), = {q^\ . . . , q^-) . 

Depending on the respective values of m and n either ()3.9p or (j3.1ip provides the most efficient 
way of computing uj{x,y;t). In the former we need to sum over all 2™ subsets of [m] whereas in 
the latter we are summing over all (^) m-subsets of [n] . A distinct advantage of the representation 
(|3.1ip (and of (|3.13p ) over (|3.9p is that it permits the computation of the t — > 1 limit, required in 
the derivation of the sta Selberg integral ()1.5p . In particular, the bisymmetric function featured in 
that integral follows as 

-.^ (n — m)l , uj(x,y:t) 
= -1 ^ lim ' ^ ^ 3.15 

[n-my. YJ Vk 



E n 



n\ — ' Vi — Xi 

^ \ ^ / TT yi+n—m 



mini 



_^ yi+n- 
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5(3 Basic hypergeometric series 

Finally we mention that F{t; x, y; t) for m = n is nothing but the well-known Izergin-Korepin 
determinant [8,11] in disguise. 

Lemma 3.3. For x = (xi, . . . , x„) and y = (yi, . . . , y„) we have 

1 \ (i-irn",=i(i-^i%) 



F{t; X, y; t) = det 



V(l - Xiyj){^ - txiyj)j Ul<:^<j^nixi " Xj){yi - yj) ' 



Since F{0; x,y;0) = 1 this reduces to Cauchy's double alternant when t = 0, see e.g., [12, 
Equation 2.7]. 

Several combinatorial interpretations of the Izergin-Korepin determinant are known, for example 
as the partition function of square ice [5, 14]. Perhaps best known is its evaluation in terms of 
alternating sign matrices [5,13]. This (together with (j3.8p and (13.121) ) implies that for m = n 

lhj=l(^i m) A i=l i,j=l 

aij=0 

Here the sum is over all n by n alternating sign matrices A (matrices with entries aij € {—1,0, 1} 
such that the ones and minus ones alternate along each row and along each column and such that 
the entries in each row and column add up to 1), Ni{A) is the number of minus ones in row i, 
N^{A) is the number of minus ones in column i, N(A) is the total number of minus ones, I{A) is 
the inversion number: 



and 



and Oij = 1 otherwise. 



aij =t if Oifc = ^ flfcj 



k=l k=l 



3.2 The rational functions and Va^ 

Related to the bisymmetric function F we introduce two rational functions W\^{u, z;q,t) and 
Vxfj_{u, z] q, t) as follows. Let A and fj, be partitions such that l(X) ^ ni and Z(^) ^ n. Then 

Wx^iu, z; q, t) = ng^n^T^ {F{u; x, y; t)) (3.16) 

and 

Vx^{u,z;q,t)=u^;;:^^u^;'\F{u;x-\y;t)). (3.17) 
There is no need to consider the more general specialization u^x-'^u^^}^ since 

From (|3.3p it immediately follows that 



,1,1, 1 „Ai— Aw J.1— J+i ^ 1 



IC[m] iel ' ^ i&I j=l ^ 

j0 



and 

zq^ 



y,,(n, z; t) = y (-n)l^lt('^')-"|/| TT ^"g; /. TT TT ^ " '^^7^ -, 



/C[m] iG/ ^ i€l j=l 
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Furthermore, from (j3.17p and Corollary 13.11 we infer that 

1 

2^qXi-j-m—n—i 



1 j.m—n—1 

i=l 



™ ^m—n—i 



and 

^A,o(l, z; q,t)=l[ (3.18b) 
i=i ^ ^ 

3.3 Proofs of the claims of Section 13.11 

Proof of Lemma \3.1[ By taking XmUn = 1 in (j3.3p it follows that the summand vanishes if m G I. 
Hence we need to only sum over / C [m — 1] , resulting in 

/C[m-1] tel ■' i€l J=l ■' 

/C[m-1] i6/ * i&I j=l 

This last expression is F(u; x*^™'^ y^"^; t), establishing ()3.4ap . 

In proving (|3.4bp we make the m-dependence of gx{u;q,t) explicit by writing g^^\u;q,t). 
Taking Xm = = in p.2p and using the stability of the Macdonald polynomials yields 

m— 1 n — 1 / x 

E bx{q, t)gt^ (n; q, t)P,{x(^^ ; q, W ■q,t)= F{u; x, y; t) U„=,„=o H 11 , ' , " 

A i=i j=i y^iyj^^foo 

Since P\{x^"^^;q,t) = if /(A) ^ m we may assume that /(A) ^ m — 1. But then 

m— 1 

4 = 1 



(1 - «)5'i™ ^\ut;q,t), 



so that 

(m-l) 

A 



(1 - n) 6a (ut; q, t)Px (x(-) ; (y^^^ ; 9, t) 



m— In— 1 / N 

F{u;x,y;t)U^=y„=o [[ [[ 



i=l 



Summing the left-hand side using (j3.2p (with (n, m, a:;, y) — > (n — 1, m — 1, x^™^ , y^"^)) completes the 
proof of (l33b]). □ 

Proof of Lemma \3.SX Recall our earlier comment following (j2.24p that the i<I>o series naturally arises 
from the sum side of the Cauchy identity (j2.25p by application of the homomorphism ea,t (acting 
on y). It is therefore an obvious idea to apply ea,t to the more more general identity 

bx{q, t)gx{u; q, t)Px{x; q, t)Px{y; q, t) = F{u; x, y; t) H H / '^''"^^ " 
A i=lj=l y^iVj^Doo 
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5(3 Basic hypergeometric series 
Doing so and using (l236l) . (l2:23l) . 0:261) and 



gx{u;q,t) = go{u;q,t) 



iuqt^-';q,t)x 
{ut^-^]q,t)x ' 



yields 



go{u;q,t) 2<^i 



a, uqt 



m—l 



.1 ) 9) ^1 



ea,t{F{u;x,y;t)) 



or, equivalently, 



ia,t{F{u;x,y;t)) = go{u;q,t) 2^1 



a, uqt 



m—l 



.1 ) '?) ^) 



n 



{axi;q)c 



\ {axi;q)c 



(3.19) 



(3.20) 



Taking a = uf^ the 2^1 reduces to a i$o which may be summed by (j2.24p . so that 



,t{F{u;x,y;t)) = go{u;q,t)Y[ 

m 



{uqf^ ^Xi;q)c 



1 - ut""-' 



1=1 



in accordance with ()3.5ap . 

To also prove (j3.5bj) we have to prove identity (13. 6p (see the comments immediately following 
Lemma I3.2D. Hence we need to show that 



By taking the logarithm on both sides this is equivalent to 

- - log(l - tzyj)^^ = log(^Y 



l-z 



az 



1 - z 



az 



Using the series expansion for log(l — x), then interchanging sums and finally using definition ()2.5I 
of the power sums, this yields 



By (|2.15p this simplifies to 



which is obviously true. 



E 



E 



(1 - t'^)z'' 



m 



■Pm{y) = lo, 



1 - z 
1 — az 



(1 - a"')z' 



m 



log 



1 - z 
1 — az 



□ 



As an aside we note that (13. 6p and (|3.19p may be combined to yield the following generalization 
of the Kaneko-Macdonald g-binomial theorem (j2.24p : 



2^1 



a, uqt 

Uf"' 



m—l 



-j^ , q,tj X 



n(i - ut^' 



1=1 



n 



{axi;q)c 



1 - Xi 
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Proof of Proposition [XTl Since Lo{x,y;t) is symmetric in x it suffices to prove tlie proposition for 
k = m. 

It follows from (13. 9p that u!{x, y; t), viewed as a function of Xm, has simple poles at Xm = Xi for 
1 ^ z ^ m — 1 and Xm = tyj for 1 ^ j ^ n. However, since a;(x, y; t) is symmetric in x, the first set 
of poles must have zero residue. 

It also follows from (I3.9jl that 

lim uj{x, y; t) = 0. 



Indeed, if uji{x, y; t) is the summand of (j3.9p and if / C [m — 1], then 

lim uJi{x,y;t) = - lim a;/u{^}(x, y; t). 

Xm ^OO >00 

The above observations imply the existence of the partial fraction expansion 

" A, 



u;{x,y;t)=Y, _ . 
with Ai = Ai{x^"^\y;t) determined by 



Ai = lim {xm-tyi)uj{x,y;t) 



n 



In the limit, only sets / containing m give a nonvanishing contribution. A straightforward calculation 
thus gives 

n 

^ , , ~ ''^j "TT TT 



n -^» ~ '"^i TT TT 

G/-{m} * i€l-{m}j=l * 



Rewriting the sum as a sum over [m — 1] this becomes 



By 



n m— 1 n 



TT - y; -i-r T-r Xj - yj ^ -|-|- Xj - yi -p-r -p-r 3;^ - j/j 

K Xi — tvi Xi — tyj ■!■ 4- a^j — tw; -I- -j- J- — ty,- ' 

this finally yields 

. , _ n n 1^ E n 1^ n n 

«=1 J = i /C[m— IJ «Gi J=l 

m—l n 

= (1 - ^(xM, JJ JJ 

fj^ Xi - tyi j-J^ yj - yi 
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as required. □ 

Proof of Proposition \3.'A We first symmetrize the right-hand side of (j3.13p with respect to y and 
compute 

■j^J Ui+n—m JJ' Ui Wj JJ' Uj+n- 

u^^^y i=l ~ ^Vi+n-m i^i<j^„ Vi " Vj i^^<j^„ ^» ~ 

To this end we write each permutation w as w = (o"i, . . . , an-m.-, h, ■ ■ ■ , Im)- In summing over w we 
first sum over the <Tj for fixed li, . . . , Im- This yields, 

n m n—m m -tr , , / 

V ft TT TT ' TT ^^"^'^ -*yi^ V jf TT 

ii -r. — /i;, 11 11 y;.— 7/, 11 T.—fii, 7/, —7/, ^ I 11 



^^Xi — tvi. ^^^^Yi—V]. Xi — tyi . vi—yi. ^ \ -'■-jr — y, / ' 



where Y = (Yi, . . . ,Yn-m) = y^'i-'^'---.'™.) g^^id where we have used the symmetry of the double 
product involving Yi and yi- to pull it out of the sum over Sy . Carrying out this sum using [16, Ch. 
Ill, (1.4)] 

we obtain 

{t; t)n-m ^ -Q Vh -Q -Q - "Q - yi^ yi^ - tyi^ 



(1 - " /i,.fr:=l f=l - ^^'^ f=l ,=1 - - yk - Vh 

If we denote the expression on the right of (j3.13p by u!{x, y; t), and use that 

n—m m -tr , n m , 

nn&= n W 



, . ••■,1m, 



the above calculations imply that 

n / m n m , 



^ -|-|- - txj Xi - yi. yi^ - tyi^ 

Xi—Xn Xi — tyi . y; — y; y ' 

where 

(^) ^)m 

The expression for uj{x,y;t) given by (|3.11|) is also a sum over the /j but unfortunately the two 
summands do not equate and some further manipulations of the sums are required. 

To proceed we apply 

n 

E /(y')= E E ^ifiyi))' (3-22) 
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with yi = {yi^,. ..,yi^). Therefore 

n m , 



n 



Xj - tXj _ Xj - yi^ ^ yi^ - tyi^ 
Xj — Xj Xj — tyj . vi. — vi . 



We now invoke the following lemma, which reduces to (|3.21|) for v = u. 
Lemma 3.4. For u = (ui, . . . , m„) and v = {vi, . . . , Vn) there holds 

w( f] ^ TT ~ ~ ~ 

^ \^^Ui—tVi Ui — Un Uj—tVi Vi—Vj 



(t; i)n ^ u)/^ 1 j-j- - - 



Since 

m n m , 

Uy^. n n^^^ 

i^h,...,lm 

is symmetric in yi, Lemma 13.41 (with {n,u,v) — > {m,x,yi)) may be applied to yield 



n m 

X 



1=1 * 



n n^^3^ n _ 

i=i j=i y^ i^i<j^m ^* ^^'j 

i^ll,...,lm 



Reversing (|3.22|) we finally get 



(1 — t)™ ^ ^^Xi—tyi. Vi — Vi ^ , Xi — till . vi—yi. 

Comparing this with p.lip we see that = uj and the proof is complete except for a proof of 
Lemma 13.41 □ 



Proof of Lemma \3.4\ Defining 



/ ^^ TT 1 Yj Ui - Vj Vi - tvj 
g{u,v;t) = \\ — I I 

Ui — tVi ^ Ui — tVj Vi — Vj 

1=1 li~'t<ji~.n ■' 



the proposition states that 



E -(^(-'-'0 n ^)=7i%E-(^(-'-'0)- (3-23) 

The difficulty is that it is unclear that the right-hand side is symmetric in u. For example, when 
n = 2 it reads (without the (u, u )-independent prefactor) 

1 1 Ul — V2 Vl — tV2 ^ 1 1 Ul — Vl V2 — tVl 



Ul — tVl U2 — tV2 Ul — tV2 Vl — tV2 Ul — tV2 U2 — tVl Ul — tVl V2 — tVl ' 
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5(3 Basic hypergeometric series 
which appears symmetric in v only, but is in fact equal to 

(1 + t)(tVlV2 + U1U2) - t{vi + V2){UI + U2) 
(Ul - tVi){ui - tV2){u2 - tVi){u2 - tV2) 

Let Tj^ u G &u by the fcth adjacent transposition acting on u: 

Tk,u{f{u)) = f{ui, . . . ,Uk-l,Uk+l,Uk,Uk+2, ■ ■ ■ ,Un)- 

The Tk^u for 1 ^ ^ n — 1 generate ©„, and to prove that the right-hand side of (jc{.23p is symmetric 
in u it suffices to show that it is invariant under the action of the Ifc „. That is, we must show that 

or, equivalently, 

w(^Tk,uig{u,v;t))^ = w{g{u,v;t)) (3.24) 

since Tk^u commutes with the ii-symmetrization. 
A direct computation shows that 

Tk,u(g{u,v;t)) = g{u,v;t) - — — g{u,v;t). 

[Uk - Vk+l){Uk+l - tVk) 

Acting with (3^ it thus follows that p.24p holds if 

Y w{h{u,v;t)) = (3.25) 

for 

h{u,v;t) = -—-g{u,v;t). 

[Uk - Vk + l)[Uk+l - tVk) 

Given an arbitrary permutation w = {wi, . . . , Wn) G &v let w' G be given by 

w' = {Wi, . . . ,Wk-l,Wk+l,Wk,Wk+2, ■ ■ ■,Wn)- 

Another direct computation shows that 

w{h{u,v;t)^ = —w' {h{u,v;t)) . 

Therefore 

Y w{h{u,v;t)) = - Y w{h{u,v;t)) 

from which p.25p follows. 

Now that the n-symmetry of the right-hand side of (I3.23P has been established the rest is easy. 
By (imD 



RHS(I323])= Y ^(^^^-^) E ^(5(n,^;t)) 

completing the proof. □ 

Proof of Lemma \3.3l The entries of the determinant may be expanded by 

'a + 1 



I = y 

{I - xy){l - txy) ^ 
17 
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where 



is a g-binomial coefficient. By multilinearity this gives 

oo 



det 



Y det (yf) 



oi,...,a„=0 



where 



Q + 1 
a 



n 



ai + 1 



Q + 1' 
Q 



Since the summand vanishes when two (or more) of the summation indices coincide and since the 
product of i-binomials is symmetric in a, this may be rewritten as 



det 



••>a„=0 w£&a 
oo 

y det (yf) 

cn>-->an=0 

oo 

y det (y°') det ixf) 



a + 1' 

a 



a + 1 



e(w)x 



ui(a) 



ai>-->a„=0 



a + 1 



where e(w) in the second hue denotes the signature of the permutation w. 
Setting OLi = Aj + n — i + 1 and using (j2.9p this becomes 

[Aj + n - i + 1 



det 



A(x)A(y)j;.A(^)sA(y)n 

A j=l 



Aj + n — i 



Recahing that m = n we have 



n 

i=l 



Xi + n- i + 1 
\i + n — i 



^ 9x{t;t,t) 
t (1-0" 



so that 



V5A(t;t,i)sA(x)sA(y) = (l-t)"^ det 



1 



A(x)A(y) 



A 

By (j2.8p the left-hand side may be recognised as the left-hand side of (j3.2p for ni = n, q = t and 
u = t. Hence it may be replaced by the corresponding right-hand side, leading to 



F{t;x,y;t) = {l-tr det 



A(x)A(y) 



as claimed by the lemma. 



□ 



4. An identity for q, t-Littlewood Richardson coefficients 

In our proof of the 5I3 q-binomial theorem ()1.4p we require the following identity for the q, t- 
Littlewood-Richardson coefficients. 

Theorem 4.1. Given integers ^ m ^ n, let X and /j, be partitions such that Z(A) ^ m and 

18 
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^ n. Then 



{qt"'-^-';q,t). 



nn 



Since f^^{q, t) = if w ^ A and -P^^/a; = if ^ /U we may add the restrictions to Q X and u> Q ji 
to the sum over uj. It may in fact also be shown that the summand on the left vanishes unless 

\i ^ ^^i+n-m for 1 ^ i ^ m. (4.1) 

In other words, if //* is the partition formed by the last m parts of /i (i.e., /i* = {^n-m+i, ■ ■ ■ , fJ'n)) 
then the summand vanishes unless /x* C A. 

To see this we recall from [16, Equation (VI. 7. 13')] that 

P,j./w{xi, ■ ■ .,Xn-m;q,t) = ^'llJT{q,t)x^ , 

T 

where the sum is over all semistandard Young tableaux T of skew shape fj, — uj over the alphabet 
{1, . . . ,n — m}; is the monomial defined by T and ipT £ ^- For the shape ^ — u> to have an 
admissible filling it must have at most n — m boxes in each of its columns. Hence uji ^ ^ij^n-m 
for 1 ^ i ^ m. Since we already established that the summand vanishes unless u; C A, a necessary 
condition for nonvanishing of the summand is thus given by (|4.ip . Since l/{q;q)-N = for a 
positive integer, it is easily seen that also the double product on the right-hand side of the theorem 
vanishes unless ()4.1|) holds. 



Proof of Theorem \4-l[ We start with (13. 2p with A replaced by r] and apply the homomorphisms u^^^ 

(acting on x) and li^"-* (acting on y). Using the homogeneity (|2.7p of the Macdonald polynomials 
and recalling ()3.16p this leads to 

z^''\{q, t)gv{u; q, t)u^;:'\p,)u^;^HPv) 

V 

The summand on the left vanishes unless l{rj) ^ m. Assuming such rj we may twice use the 
symmetry (I2.12|) to rewrite the left-hand side as 

Next we apply as well as (j2Tl) to get 

(P^) = P^{q^H^-\ q^-e-^, ...,t,l;q,t) 

(n—m) , 



J2 PM^'t^-', • • • , q'^-t^-"'; q, Onr'"^ (^M/-) 

UJ 

j;t("-™)l-ln(-)(P^)4"-™)(P,/J. 
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Thus 



Next we use that 

= 4'"^(E/-a(^'*)^0 (by dZIED) 

V 

V 

to rewrite this as 



(n-m)/p \„,(m)/-p A,,(™)|'p \„(")/'p \ 

LHSM = E .'^lt(— )H/:,(,,t)6,(g,t),,(.;,,t) (^^H (^i^o (^.) 

By one more appUcation of (|2.12p this becomes 

LHS(142j) = 2^ zi'it^ ^1 ^fuj\[q,t)br,{q,t)grf{u;q,t) r^^y- — — y- — ^ . 

As a result of the previous manipulations the sum over ry corresponds to 
Y,^^%{q, t)g^{u; q, t)^-) {P^)u^^^ (P,) 

V 

= ulJl'Ju''^U^bn{q,t)gn{u;q,t)Pn{x;q,t)Pn{y;q,t) 
= ni'Sul^^ (pin; X, y;t)f[fl pllM^) (by m. 



W,^{u, z- q, t) y^'l'^-^y)- TT (^^"+""^g)oo ^ (f5J6]l ). 



We thus arrive at 

/ j.?T.-|-?71 — i \ 

LHSg2]) = n ' 



11 {zt^-^-q)^ 

Y,t^"^^''^f:,{q,t)W,,o{u,z;q,t) 



X 



ut'^HP./JutHP.) {zt-^;q,t). 



Finally equating this with the right-hand side of ()4.2I) yields 



ut'^\p,/^)u'^\p.) {ztr-'\q,t\ 



m n ( .n+m-i-j \ 
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5(3 Basic hypergeometric series 

Both sides of this identity triviahy vanish if /(A) > m. Furthermore, the summand on the left 
vanishes if Z(i^) > m. Hence we may without loss of generality assume in the following that 1{X) ^ m 
and ^ m. (The latter of course refers to a restriction on the summation index.) We may also 
assume that the largest part of z/ is bounded since f^^ = if + |A| 7^ \u\ and P/x/uj = if u; ^ ^. 
In particular ui ^ |A| + |;u|. 

The above considerations imply that A, C [N"^) for sufficiently large A^. Given such N we 
can define the partitions A and ft as the complements of A and v with respect to (N"^), i.e., 
Xi = N - Xm+i-i and i>i = N - Um+i-i for 1 ^ z ^ m. 

We now replace z — > q^~^~^ / z, A — > A and — > i> in (|4.3p . and then eliminate the hats. For 
this we need the easily established 

W'^^{u, q^-^-^'lz- q, t) = Vx^iu, z; q, t) 

as well as [26, page 263] 

^ " ' i<lt-^;Q,th cUq,t) ^M(^p^y 

[3, Equation (4.1)] 

{a;q,t)'^ _ / 6\ |A| (a; g, t)(;v-) (q^-^t""-^ /b; q,t)x 



{b;q,t)~^ \aJ {b;q,t)^Nm) {q^-^t^-ya; q,t)x' 

and 

4"^)(P3^) = t(T)^+(i— )iAi4-)(p,). 

This last result follows from [3, Equation (4.3)] 

P'^{x;q,t) = (xi • --Xm)^ Px{x~'^;q,t) 
and the homogeneity (12. 7p . As a result we arrive at 



V 



E^n{y)-\uj\ f\ ^\T/ ^.^ -f^,, "-™ rp (g^ -.zqt ,q,t 
' cUQ,t){zqt"^ i;g,t) 

= Vx, (n, g, On (P^) . / TT TT ^ 

where we have also that /^^ = if |a;| + 7^ |A|, and 

{a;q)N-k {a;q)N {q^~^ /b;q)k (b\k 



{b;q)M-k {b;q)N (g^ ^/a;q)k\a^ 
Finally specializing z = 1 complete the proof. □ 

5. 3(3 basic hypergeometric series 

Below we will give two different definitions of sl^ basic hypergeometric series, denoted Type I and 
Type II respectively. To cover both types at once we introduce the function Vx^{q, t) which is either 
given by 

Vxf,{q,t) = Vxf,il,l;q,t) Type I 

or by 

Vx^{q,t) = q-\^\Vx^{e-'^+\l;q,t) Type II. 
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Note that it follows from (j3.17p and (|3.8p that for Type I series, 

From p.lSap and ()3.18bp we see that regardless of our choice of Vx^{q,t) 

\ — q\ifra-n-i 



{qt 



m— 71— 1 



(5.1) 



It is important to observe that Vx^{q,t) does not merely depend of the partitions A and /x but 
also on the integers m and n. (We tacitly assume that Z(A) ^ m and /(/x) ^ n.) These integers 
are mostly assumed to be fixed, but occasionally we will relate series labelled by (m, n) to those 
labelled by (m — l,n — 1). If we write v!^^'"\q,t) instead of Vx^{q,t) it follows from Lemma l3.ll 

that vj^^'^\q,t) only depends on the difference n — m. Specifically, 



provided of course that /(A) ^ m — 1 and ^ n — 1. 

To reduce the length of many of the subsequent formulae we introduce another rational function 
Qxf,iq,t) as 

m n / ,j_j-(-m-7i-l. 

nxf^iq, t) = vx,{q, t) (gt"-^ (?, t)x n n 



(m— l,n— 1) 



(5.2) 



i=ij=i 

where A and fj, are partitions such that /(A) ^ m and ^ n. 
Two easily established results for Qxfj.iQ,t) are 

nx,o{Q,t) = {t"'-''-';q)x 
and, displaying the (m, n) dependence, 

^.n—l. 



t+m—n. 



) q)Xi-fj.j 



(5.3) 



(5.4) 
(5.5) 



for /(A) ^ m — 1 and /(/u) ^ n — 1. Equation (|5.4p follows from (j5.ip and 



nn 



.j —i+m—n~l . 



)Xi-IJ,j 



and (15. 5p follows from (j5.2p and 



((7t 



m— n— 1 . 



=0 iqt"'-^;q,t)x 



nn 



j—i+m- 



(gf 



m-2. 



,t)A (t"-^g,t);. 



Am — /in — 



We can now state the main definition of this section. 



Definition 5.1 5(3 basic hypergeometric series. Let x = {xi, . . . ,Xm) and y = {yi, 
that ^ m < n. Tiien 



,yn) such 



ai, . . . , 
bi,...,br 



;q,t;x,y 



n 



ixi;q)c 



\ {Xit 



.j-m— n— 1 . , 



A, /I 



-PA(2;;g,t) -P^(y;g,t) (ai, . . . ,a,.+i;g,t)^ 

^\ti[q,t), (5.6) 



CA(9,i) c^g,t) (bi,. . . ,br;q,t)^ 
where the sum is over partitions A and ^ sucii that /(A) ^ m, /(^) ^ n and 

^i—m+n for 1 ^ i ^ m. 
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Remarks. 

i) The restrictions on the sum may alternatively be expressed by the inequalities [25, Equation 
(2.4)] 

Ai ^ A2 ^ . . . ^ Am 

w w w 

Ail ^ • • • ^ fJ-n-m+l ^ /^n-m+2 ^ • • • ^ Ain, ^ 



ii) The prefactor 



n 



in the definition has been included to simplify subsequent formulae, and implies that for ai = 1 
the sis series simplifies to 1, see Lemma 15.21 below. 

iii) The main reason for attaching the label 5I3 to the series of Definition 15.11 is the connection 
with the sis discrete exponential and continous Selberg integrals of Tarasov and Varchenko, 
see page [28] for details. 

We should also mention that we are currently developing a theory of sin basic hypergeometric 
series [27]. In such series, a Macdonald polynomial is attached to each vertex of the s(„ Dynkin 
diagram, and the corresponding sin g-binomial theorem may be expressed concisely in terms 
of the data of the undelying Lie algebra. 

iv) Finally we remark that nearly all our results involve non-terminating SI3 series. To ensure 
convergence we implicitly assume that 

max{|g|, . . . , \xm\, |yi|, . . . , \yn\} < 1 

whenever necessary. 

Our most important results for SI3 basic hypergeometric series are two generalizations of the 
g-binomial theorem. First however, we state several elementary properties of the series. In all of the 
results below the parameters ai, . . . , a^+i and bi, . . . ,br act as dummies, and to shorten some of the 
equations we abbreviate these sequences by A and B respectively. 



Lemma 5.1. We have 



r+l^r 



■,q,t;x,iO") 



Proof of Lemma [Ql Since P^((0"'); q, t) = 5^^^ we get 



;g,t;a;,(0") 



ixi;q)c 



S^.n(\) P\ix]q,t) 



Thanks to (El) this is 



;(7,t;x,(0") 



1^0 



j.m—n—1 



;q,t;x 



n 



ixi;q)c 



m—n—l. 



where on the right we have used definition ()2.23p of the 5I2 Kaneko-Macdonald series. Summing 
the i$o series by the (/-binomial theorem (j2.24p results in the claim of the lemma. □ 



Lemma 5.2. We have 



1, 02, . . . , ar+1 

bi,...,br 
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Proof of Lemma lS.SX When ai = 1 the summand vanishes unless /i = 0. The proof is thus a repeat 
of the proof of Lemma 15. 1[ □ 



The next two lemmas relate series with labels (n, m) and (n — 1, m — 1). Recall the notation 
introduced in Section [3l 

Lemma 5.3 (Stability 1). With Uq"^ acting on y and Uq"^^^ acting on y^^\ we have 



4?i ( r+l^r 



(n-l) 



0;tz \ r+l^r 



Lemma 5.4 (Stability 2). We have 



t,(x(™),0),(y("),0) 



Iterating the two types of stability leads to 



4"i ( r+l^r 



(n—m) 



A 



■,Q,t;y 



and 



A 



-t;(o™),(y( 



n— m+l,...,n) g'"i^ 



B 

f^,B 



Note that both right-hand sides involve the s[2 Kaneko-Macdonald series. 

Proof of Lemmas 15.31 and \5.4\ Because we are comparing series for different (m, n) values we write 

jj^sl^gad of ^A^i- 

If Xm = only partitions of length strictly less than m contribute to the sum over A. But if 
Am = then the inequality ^ /i„, ^ Am implies that also /i„ = 0. Hence we may use (15. 5p and the 
homogeneity of the Macdonald polynomials to obtain 



;g,t;(x('"),0),y 



m— 1 



n 



X,fi 



\ (xii™-"-i;g)oo 
n(\)+n(^) Px{x^"'^;q,t) P^{ty;q,t) {t''-^ A; q,t)^ ^(m-i,n-l) 



c'^{q,t) c'^{q,t) {t^\B-q,t)^ 
where the sum is over partitions A and ^ such that /(A) ^ m — 1, /(^) ^ n — 1 and 

Ai ^ /J-j 



H—m+n 



for 1 < i < m — 1. 



All terms on the right-hand side depend on n — 1 and m — 1 except for P^{ty; q,t), since y = 
(yi, . . . , yn)- We can either make the obvious choice yn = and use the stability of the Macdonald 
polynomial: P^(t(y^"\ 0); g, = Pp^{ty^'^^;q,t) to obtain Lemma 15.41 or we can specialize y. In the 
latter case we may use that for ^ n — 1 



•S {P,{y: q, t)) = nf' {pM"-^ ; q. t)) 

V'' ) y? '^jf- 



(5. 



as follows from (j2.1ip . Therefore 



■,q,t; (a;(™),0),y 



m— 1 

n 

i=l 



{xi;q)c 



(Xit 



m— n— 1 . 



;q)c 



V- ,n(A)+n(^) ^A(a;^'");g,0 ^0;t4^M(^^" '^ig^O) (-4; 9, t)^ l'""!) f ^ 
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in accordance with the right-hand side of Lemma 15.31 



□ 

Our next result imphes all previous four lemmas, but unlike the latter it is not elementary, 
requiring Theorem 14.11 for its proof. 



Proposition 5.1. Fix a as 



a 



for Type I 

1 for Type II 



(5. 



and let X = {Xi, . . . , X„) be given by 



Then 



A 
B 



Xi 



q ^Xi for 1 ^ i ^ m 
^n-i for m + 1 ^ i ^ n. 



n(fi)+m\fi\ M 



P^{y;q,t)P^{X;q,t) {A;q,t) 



c'{q,t)u^^\p,) {B-q,t)^- 



(5.10) 



Note that by taking y = (0"") or oi = 1 the summand vanishes unless = leading to Lemmas l5.1l 
and l5.2[ Also the Lemmas 15.31 and 15.41 immediatelv follow from the proposition be it that the latter 
also requires (|5.8p . For example, applying ulyl acting on y to (j5.10p yields 



A 



q,t;x,y 



c'n{q,t) {B;q,t)f, 



Not only does this make Lemma 15.31 obvious but it in fact implies the following more general (and 
more important) result. 



Corollary 5.1. With the same notation as Proposition 15. il we iiave 



4?i { r+l'^r 



A 
B 



;q,t;x,y 



r+ 



A 

B' 



q,t;zt"'X 



(5.11) 



'A 




= r+l^r 


'A 


5'' 


l,t;x,y 


^;q,t;y,x 



Note that on the right we have the 5I2 Kaneko-Macdonald series. 
There is another important corollary of Proposition 15.11 If we take m = n then 

P^{X-q,t) = q-''\>'\t-\^'\p^{x-q,t). 

Hence for m = n the series (I5.10p is invariant under the interchange of x and y. 

Corollary 5.2. For m = n, i.e., x = (xi, . . . , Xn) and y = (yi, . . . , y„), tiiere holds 

r+l^r 

Using the above two corollaries it is straightforward to prove several g-binomial theorems for 5I3 
series. First however we shall prove Proposition 15.11 

Proof of Proposition 15. jl Recalling definition ()5.3p and using ()5.ip , Theorem 14.11 may be rewritten 

as 

^x^{q,t) = j;t"('^)-"(")+™l^l-'"l/i(g,t)c',(g,t) 

^^ V,,o{u,l;q,t) Vx^,{q,t) u^"\P^,^) {t^-'-^;q,t), 
Vufl{q,t) Vx^{u,l-q,t) ul^\P^) c^g,*) 
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Taking u = I or u = t"' so that 

Vu,o{u, l;q,t) V\f,{q,t) 



and using that /^^ = if + / |A| we obtain 



,-<Ti\X\-\u\) 



^0 \^ f-^J 

Substituting this in the definition ()5.6p of the SI3 basic hypergeometric series leads to 



A 



q,t;x,y 



n jxi; g)oc 

i=l ^^'^ 



00 



Now performing the sum over A by (j2.18p yields 



A 



q,t;x,y 



n 



ixi;q)c 



The next simplification arises by noting that the sum over i/ corresponds to a summable sl2 Kaneko- 
Macdonald series: 



1^0 



qt 



m—n—l 



■,q,t;x 



n 

i=l 



{xit^-'^-^-q) 



{xi;q)c 



by ([2:23]) and OTMl) . Hence 



B 



;Q,t;x,y 



n{fi)+rn\fi\ — \w\ 



c;,(g,t) {B;q,t), 



Next we use the homogeneity (j2.7p of P^^, the definition (j2.10p of the principal specialization Uq 
and the definition (j2.22p of the skew Macdonald polynomials to perform the sum over iv; 



uj\ (n-m) 

tir 



{Pt./u.)Pu>{x-,q,t) = 

UJ 

= P^{X;q,t), 



(T+— 1™ j.n—m—1 



where X = (q x, t 



,t,l). The resulting identity is (jS.lOp . 



□ 



From Corollary [5TT] it is clear that whenever an 5I2 series is summable this implies a corresponding 
sum for 5(3 series. The most obvious choice is to set r = in Corollarv 15.11 so that the right-hand 
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side of (jS.lip may be summed by the Kaneko-Macdonald g-binomial theorem (j2.24p . Hence 

{azt"^Xi;q)^ 



n 



n 



L {zq-n^'-^Xi- 



Theorem 5.1 (First SI3 g-binomial theorem). For x = {xi, . . . ,Xm) and y = z{l,t, . . . ^) we 
have 



1^0 



;q,t;x,y 



for the 5(3 series of Type I, and 



1^0 ■,q,t;x,y 



for the 5 [3 series of Type II. 



n 



{azq-^f^-^ Xi\q) 00 "^j^ (azr~*;g)c 



n 



If we assume m = n then we may first invoke the symmetry of Corollary 15.21 to find a second 
pair of g-binomial theorems. 

Theorem 5.2 (Second sts g-binomial theorem). For x = 2;(l,t, . . . jt"""^) and y = (yi, . . . ,y„) we 
iiave 

(a2;t""^yi;g)oo 



i$o 



for the SI3 series of type I, and 



1^0 



;Q,t;x,y 



;q,t;x,y 



{azq-^t'^'^yi;q) 



for til e sis series of type II. 



Using further results for 3(2 Kaneko-Macdonald series many more identities for s[3 series may 
be proved, such as g-Gauss sums, g-Saalschiitz sums, etc. Below we restrict ourselves to just one 
further applications in the form of an s[3 analogue of Heine's g-Euler transformation. 

Proposition 5.2. Let a be fixed as in ()5.9p . and let x = (xi, . . . ,Xm) and y = z{l,t, . . . ,t"~^). 
Then 



a, b 



;q,t;x,y 



2^1 



c/a, c/b 



, t; X, aby/c 



n 



{abzq-''t"'-^Xi/c;q)oc Vf {abzf^-' /c; q) 



\ {zq—t'^-^Xi;q)^ f\ {zt^-i;q) 



n 



For b = c the 2^1 on the right is 1 by Lemma 15.21 and we recover the g-binomial theorem of 
Theorem 15.11 



Proof of Proposition 15.^ According to (j5.ip 

a, b 



;Q,t;x,y 



2^1 



a, b 



,t;zt"'X 



In [3, Proposition 3.1] Baker and Forrester proved that 
2^1 



a, b 


= 2^'l 


■,q,t;x 


c 





c/a,c/b abx 
c c 



n 



{abxi/c;q)c 

^ {Xi'j 9)00 
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so that we get 



(n) 



0:z -i-i-l 



$1 



a, b 



c/a,c/b abzf^X 
c c 



n 



Again using (15. lip gives 



a, b 



,{n) 



c/a^ c/b 



{abzf^Xi/c]q)oo 
{abzt'^Xi/c; q)c 



n 

1=1 



[zt-^Xi 



Eliminating Xi completes the proof. 



□ 



Theorem 15.11 may be viewed as a g, t, x- analogue of a result of Tarasov and Varchenko, stated 
in [25, Theorem 2.3] as a sis discrete exponential Selberg integral. To obtain the Tarasov- Varchenko 
result we take t = q^ and the theorem, and let q tend to 1 .A standard computation 

using ([23]) and (pTTT]) then leads to 



P[^'''\x) 



n 



r(i - 7 + \i - jij) 

[fii - flj)T{'y + jli- jij) -r-r (Ai - Aj)r(7 + Xj) 



(5.12) 



r{l - J + fli ~ jij] 



n 



r(i - 7 + Ai - Xj 



(1 _ 2)-(/3+(n-l)7){n-m) 

1=1 



" r(.7)r(/? + 7(i-i)) r(i7)r(i + 7(i - n - 1)) 

1=1 ^ i=l 



r(7) 



Here 



Ai = Ai + 7(m-i) and jli = + ^{n - i), 



P'f'\x) is the Jack polynomial: 



p'f\x) = \\mP^{x-e,t) 



and 



g— >1 



Xj - Aj + 7 



E(-i)"'n > > 



/CM 



ie/ i=i - /^j - 7 



(1/7) 



Taking x = {w'^) and using the homogeneity of the Jack polynomials (so that P^ 
^ImIp^^/t) ^X'")) results in the Tarasov- Varchenko identity. To make the correspondence exact we 
need to recall the difference in normalization exhibited in (j3.14p . and the fact that 



J|r(l+7(i-n-l)) 



i=l 



(-7)™n! 
(n — m)\ 



JJr(7(i-n-l)). 



1=1 



It is interesting to note that Tarasov and Varchenko obtained the x = {w^) instance of the series 
(I5.12P as the coordinate function of the hypergeometric solution of the sla dynamical differential 
equation of [24] with values in the weight subspace L\[X — nai — ma2], X E CAi. Here Lx is 
an irreducible sla highest weight module of weight A, and and Aj {i = 1,2) are the roots and 
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fundamental weights of sis. The existence of identities such as (|5.12p (with x = (w"^)) and their 
associated integral evaluations was anticipated by Mukhin and Varchenko who formulated a very 
general conjecture regarding g type Selberg integrals being expressible in terms of products of 
gamma functions [22, Conjecture 1]. 

By a standard limiting procedure the sum (j5.12p (with x = (w™) may be transformed into an 
integral, leading to the 5(3 exponential Selberg integral of [25, Theorem 3.1]. More generally, if we 
first transform Theorem 15.11 into a g'-integral and then take the q ^ 1~ limit we get a more general 
5(3 Selberg integral, not contained in [25]. More precisely, we take Theorem 15.11 (for Type I series) 
and apply the homomorphism u^J^ acting on x. Thanks to (j2.12p and (j2.14p this yields 

J^,IA|>l,n(A).n(.) ^ 

"0 ^ ll ^zt^rn-^~l^qu,.q^^ {wt""-' q''^ ] q)oo fJi (-zt"~*;g)oo ■ 

Next we replace {a,w,z,t) — > (g("'^i)T+", g^i , g/32-m.7^ ^7) and use the definition of the g-gamma 
function to interpret this as an (m + n)-dimensional g-integral. Taking the limit (7 — > 1 then yields 
a sfs Selberg integral involving Jack polynomial. The precise details of this essentially elementary 
calculation will be given in a future paper in which more general Selberg-type integrals will be 
considered. 

To give the exact form of the integral we need to borrow some notation from [25]. Let M be a 
map 

M : {l,...,m}^{l,...,n} 

such that 

M{i) ^ M{i + l) 

and 

1 ^ M{i) ^ n - m + i. 

It is easily seen that there are exactly 

n — m+lfm + n^ 



n + 1 V m 
admissible maps M. 

Let L>™'"[0, 1] C [0, 1]™+'^ be defined as the set of points 

P = {xi,...,xm,yi,---,yn) 

such that 

^ Xi ^ X2 ^ . . . ^ 

/A /A /A (5.13) 

^ yi ^ • • • ^ Vn-m+l ^ yn-m+2 ^ • • • ^ Vn- 

The X as well as the y coordinates P £ Z)''"'"[0, 1] are totally ordered, but only a partial order exists 
between the Xi and the yj. We now write D™'"[0, 1] as a chain: 

I)-''^[0,1] = 5]I)^/"[0,1], 



M 

where Z)^'"[0, 1] C L)'"'"[0, 1] is defined by points P endowed with a total ordering among its 
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coordinates, by supplementing (j5.13p with 

yM(i)-i ^Xii^ yM,(i) for l^is^m, 
where yo := 0. We further define the chain 

C-'"[0, 1] = ^f;^'"(7)D-''^[0, 1], (5.14) 

M 

where 

F™'"(7) = ft '^™(^(^ + n-m- M{i) + 1)7) 
*^ sin(7r(i + n — 771)7) 

Up to a trivial transformation (corresponding to the variable change (5.15)) the above chains coin- 
cide with those of [25]. 

Finally introducing the Pochhammer symbol 

{a)N = a{a + l)---{a + N -I) 

and recalling the definition (j3.15p we are in a position to state the integral analogue of Theorem 15. 1[ 

Corollary 5.3 (5(3 Selberg integral). Let u he a partition of at most m parts. Then 

„ m n m n 

J p(^/''Hx)h{x,y) llx^'-'l[{l-y,r-'y^'^'\A{x)\'^ \A{y)f^ lll[\x, - y,r dx dy 

^ ((j - i + 1)7).,-., " r(a + i)7)r(77) Yf r(/?2 + 1)7) 

((^■-^)^)--. i\ r(7) ii ^(a + /32 + (^ + n-2)7) 



m 



r(/3l + (7T7 - i)7 + 7/,)r(/?l + /?2 + (777 - Z - 1)7 + 7^i)r((7 - 77 - l)7)r(77) 



where 



+ (2777 - 77 - 7 - 1)7 + 7^i)r(a + Pi + p2 + {m + U - 1 - 2)-f + Ui)T{j) ' 

Re(a) > 0, Re(/?i) > 0, Re(/32) > 
1 Re(Q) Re(/?i) Re(/?2) Re(/?i + /32) 



mm 



rl Re g Re /^i Re /^2 Re /^i + \ ^ ^ , . ^ 
\ r> 7> ^ — \ < Re 7) < 0. 

1-77 77 — 1 777 — 1 77 — 777—1 777 — 2 J 



The conditions on a, /32 and 7 (which are only sharp when = 0) are valid for generic 77 and 
777 and need small modifications when 777 = 0, 1 or 777 = 77. The conditions are correct for 77 = 1, 
777 = 2 or 77 = 777 + l provided 1/0 is interpreted as +00. Conditions that are sharp follow by 
demanding that the arguments of gamma functions appearing in the numerator on the right have 
positive real part. We also note that without loss of generality one may assume that u has at most 
777 — 1 parts, since 

SO that Vn may be eliminated by a rescaling of Pi. 

For 777 = Corollary 15.31 is the Selberg integral (II. 3p up to some trivial changes. Indeed for 
777 = we get, after replacing P2 by /3, 

" r(a + (7-l)7)r(/5 + (i-l)7)r(77) 



I \A{y)\'^flil-y,r-'yt'dy = fl 



,_ . r(a + /3 + (i + 77 - 2)7)r(7) 
Since the integrand is symmetric in y and 

n mi) _ 1 A r(i7 + 1) 
ii r(-^\ 77,1 11 



Lr(7) r7!l^ir(7 + l)' 
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this yields (jl.Sp with a and (3 interchanged. (Alternatively one may replace — > 1 — yi for all 
1 ^ i ^ m instead of replacing a (3.) 

When 1/ = all reference to the Jack polynomial pI^^ [x) disappears from Corollary 15.31 and 
we obtain the Tarasov-Varchenko integral (jl.Sp . To make the connection with the integral of [25] 
precise one needs to replace 

Xi^l - Si, Ui ^ 1- ti, (5.15) 

n — > /ci, m — 5- /c2, 

a ^ a + 1, /3i ^ (32 

and observe that 

ki 

h{i -s,i-t) = (-1)^^ 

i=l 

where hi^^i2,m.{t] s) is the function defined in Section 5 of [25]. Then correcting a factor (— 1)'^^ missing 
in [25] one obtains the integral 

given by the final two equations of that paper. 

For u = {Y) the Jack polynomial simplifies to the elementary symmetric function: 

P[ir){x) = er{x) = ^ Xi^---Xi^ 

l^ji<i2<--<ir^m 

and Corollary 15.31 yields an 5I3 version of Aomoto's integral [2]. 
Corollary 5.4. For ^ r ^ m 

„ m n m n 

j er{x)h{x,y) l{x^'-'l[il-yir-'y^'-'\A{x)\^'' |A(y)|2^ - %-|-^ dx dy 

c;"^"[o,i] i=li=l 

m\ Tja + (i - l)7)r(z7) jf T{P2 + {i - 1)7) 
rJl\ r(7) ii r(a + /?2 + (i + n-2)7) 

fJ^\T{pi + {2m - n - i - l)j + xii r)) 

r(/3i + /32 + (m - z - 1)7 + xji ^ r))r{{i - n - l)7)r(i7) 
r(a + /3i + /?2 + (m + n - i - 2)7 + x{i ^ r))r{'y) 

Re(a) > 0, Re(/?i) > 0, Re{p2) > 
1 Re(a) Re(/3i) Re(/?2) Re(/3i + /^a) 



where 



M -> r> r> 7> ^ — f < Re(7 < 

In n — 1 m — 1 n — m — 1 m — 2 i 

and x(true) = 1, x(false) = 0. 

The comments made immediately after Corollary 15.31 still apply. 
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